chore: added missing endpoint, verifiedby and mv refresh job (CM-1030, CM-1038) by themarolt · Pull Request #3907 · linuxfoundation/crowd.dev

themarolt · 2026-03-10T12:15:47Z

Note

Medium Risk
Introduces new API surface and database migrations (new columns/indexes) plus a scheduled materialized-view refresh, which can impact query performance/behavior and operational stability if misconfigured. Broadly touches identity ingestion/verification by adding verifiedBy metadata across multiple integrations.

Overview
Adds a new public members endpoint GET /:memberId/project-affiliations that returns per-project contribution segments enriched with maintainer roles and organization affiliations, preferring manual memberSegmentAffiliations overrides and falling back to work experiences.

Extends identity/work-experience responses and ingestion to include verifiedBy (API returns now include it; DAL bulk insert persists it; integrations/enrichment populate it), and enhances maintainer-role lookup to also return maintainerFile via joins.

Applies DB migrations to support the new affiliations/role queries (adds verified/verifiedBy to memberSegmentAffiliations and adds missing indexes), and adds a cron job to periodically REFRESH MATERIALIZED VIEW CONCURRENTLY for mv_maintainer_roles with Slack alerts on timeouts.

^{Written by Cursor Bugbot for commit 5a01991. This will update automatically on new commits. Configure here.}

Signed-off-by: Uroš Marolt <uros@marolt.me>

github-actions · 2026-03-10T12:15:57Z

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

feat: add user authentication (CM-123)
feat: add user authentication (IN-123)

Projects:

CM: Community Data Platform
IN: Insights

Please add a Jira issue key to your PR title.

github-actions · 2026-03-10T12:16:05Z

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

feat: add user authentication (CM-123)
feat: add user authentication (IN-123)

Projects:

CM: Community Data Platform
IN: Insights

Please add a Jira issue key to your PR title.

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

services/apps/cron_service/src/jobs/refreshMvs.job.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

backend/src/database/migrations/V1773139177__add-verified-to-member-segment-affiliations.sql

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

CLAassistant · 2026-03-10T19:37:18Z

All committers have signed the CLA.

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

Copilot

Pull request overview

Adds support for project-affiliation retrieval in the public members API, while standardizing verifiedBy across multiple ingestion/enrichment paths and improving query performance via indexes + a materialized-view refresh job.

Changes:

Add public endpoint GET /:memberId/project-affiliations that returns per-project contribution segments with maintainer roles and affiliations (manual overrides with work-experience fallback).
Extend integration/enrichment identity payloads and public API outputs to include verifiedBy (normalized to null when absent).
Add DB migration for memberSegmentAffiliations.verified/verifiedBy, missing indexes for project-affiliation lookups, and a cron job to refresh mv_maintainer_roles every 30 minutes with Slack timeout alerts.

Reviewed changes

Copilot reviewed 25 out of 27 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
services/libs/integrations/src/integrations/twitter/processData.ts	Include `verifiedBy` on created Twitter identities.
services/libs/integrations/src/integrations/stackoverflow/processData.ts	Include `verifiedBy` on created StackOverflow identities.
services/libs/integrations/src/integrations/slack/processData.ts	Include `verifiedBy` on created Slack identities (username/email).
services/libs/integrations/src/integrations/reddit/processData.ts	Include `verifiedBy` on created Reddit identities.
services/libs/integrations/src/integrations/linkedin/processData.ts	Include `verifiedBy` on created LinkedIn identities.
services/libs/integrations/src/integrations/hackernews/processData.ts	Include `verifiedBy` on created Hacker News identities.
services/libs/integrations/src/integrations/groupsio/processData.ts	Include `verifiedBy` on created Groups.io identities (username/email).
services/libs/integrations/src/integrations/gitlab/processData.ts	Include `verifiedBy` on created GitLab identities (username/email/commit author).
services/libs/integrations/src/integrations/github/processData.ts	Include `verifiedBy` on created GitHub identities (members/orgs/email).
services/libs/integrations/src/integrations/discourse/processData.ts	Include `verifiedBy` on created Discourse identities (username/email).
services/libs/integrations/src/integrations/discord/processData.ts	Include `verifiedBy` on created Discord identities.
services/libs/integrations/src/integrations/devto/processData.ts	Include `verifiedBy` on created Dev.to identities.
services/libs/data-access-layer/src/members/projectAffiliations.ts	New DAL queries for project segments, manual segment affiliations, and work-experience affiliations.
services/libs/data-access-layer/src/members/index.ts	Export new `projectAffiliations` DAL module.
services/apps/snowflake_connectors/src/integrations/cvent/event-registrations/transformer.ts	Include `verifiedBy` for Cvent-derived identities.
services/apps/members_enrichment_worker/src/workflows/lf-auth0/enrichMemberWithLFAuth0.ts	Include `verifiedBy` for LF Auth0-enriched identities.
services/apps/cron_service/src/main.ts	Add Slack alert on cron job timeout failures.
services/apps/cron_service/src/jobs/refreshMvs.job.ts	New cron job to refresh materialized views (currently `mv_maintainer_roles`).
backend/src/utils/mapper.ts	Include `verifiedBy` in work-experience mapping.
backend/src/database/migrations/V1773139177__add-verified-to-member-segment-affiliations.sql	Add `verified`/`verifiedBy` columns to `memberSegmentAffiliations`.
backend/src/database/migrations/V1772799041__add-missing-indexes-for-project-affiliations.sql	Add missing indexes for `memberId` lookups (incl. on `mv_maintainer_roles`).
backend/src/database/migrations/U1773139177__add-verified-to-member-segment-affiliations.sql	Undo migration placeholder.
backend/src/database/migrations/U1772799041__add-missing-indexes-for-project-affiliations.sql	Undo migration placeholder.
backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts	New public API handler implementing project-affiliation response assembly.
backend/src/api/public/v1/members/index.ts	Register new `/:memberId/project-affiliations` route + scope.
backend/src/api/public/v1/members/identities/verifyMemberIdentity.ts	Return `verifiedBy` in verify-identity response.
backend/src/api/public/v1/members/identities/getMemberIdentities.ts	Return `verifiedBy` in get-identities response.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

services/apps/cron_service/src/jobs/refreshMvs.job.ts

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

services/apps/cron_service/src/main.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

services/libs/data-access-layer/src/maintainers/index.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

…-CM-1038

services/libs/integrations/src/integrations/github/processData.ts

Signed-off-by: Uroš Marolt <uros@marolt.me>

services/libs/data-access-layer/src/maintainers/index.ts

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

joanagmaia

LGTM, just small comment to remove source

Signed-off-by: Uroš Marolt <uros@marolt.me>

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.}

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts

chore: added missing endpoint, verifiedby and mv refresh job

81257ea

Signed-off-by: Uroš Marolt <uros@marolt.me>

themarolt changed the title ~~chore: added missing endpoint, verifiedby and mv refresh job~~ chore: added missing endpoint, verifiedby and mv refresh job (CM-1030, CM-1038) Mar 10, 2026

cursor bot reviewed Mar 10, 2026

View reviewed changes

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts Outdated Show resolved Hide resolved

services/apps/cron_service/src/jobs/refreshMvs.job.ts Show resolved Hide resolved

fix: fix for comments

cd6383c

Signed-off-by: Uroš Marolt <uros@marolt.me>

themarolt requested a review from joanagmaia March 10, 2026 13:29

joanagmaia requested changes Mar 10, 2026

View reviewed changes

fix: default to false

783e640

Signed-off-by: Uroš Marolt <uros@marolt.me>

Copilot AI review requested due to automatic review settings March 10, 2026 19:36

Copilot started reviewing on behalf of themarolt March 10, 2026 19:37 View session

cursor bot reviewed Mar 10, 2026

View reviewed changes

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts Outdated Show resolved Hide resolved

Copilot AI reviewed Mar 10, 2026

View reviewed changes

services/apps/cron_service/src/jobs/refreshMvs.job.ts Outdated Show resolved Hide resolved

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts Show resolved Hide resolved

fix: default to null for now

511910e

Signed-off-by: Uroš Marolt <uros@marolt.me>

cursor bot reviewed Mar 10, 2026

View reviewed changes

services/apps/cron_service/src/main.ts Show resolved Hide resolved

fix: fixes for projectLogo and maintanerFile

403fad7

Signed-off-by: Uroš Marolt <uros@marolt.me>

cursor bot reviewed Mar 10, 2026

View reviewed changes

services/libs/data-access-layer/src/maintainers/index.ts Show resolved Hide resolved

themarolt added 2 commits March 10, 2026 21:45

fix: fixes from bot reports

d60f1b8

Signed-off-by: Uroš Marolt <uros@marolt.me>

Merge branch 'main' into feat/missing-endpoint-and-verifiedby-CM-1030…

22776e1

…-CM-1038

cursor bot reviewed Mar 11, 2026

View reviewed changes

services/libs/integrations/src/integrations/github/processData.ts Show resolved Hide resolved

fix: fixed missing verifiedBy on insert

51f4d3c

Signed-off-by: Uroš Marolt <uros@marolt.me>

cursor bot reviewed Mar 11, 2026

View reviewed changes

services/libs/data-access-layer/src/maintainers/index.ts Show resolved Hide resolved

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts Show resolved Hide resolved

joanagmaia approved these changes Mar 11, 2026

View reviewed changes

fix: removed source

5a01991

Signed-off-by: Uroš Marolt <uros@marolt.me>

cursor bot reviewed Mar 11, 2026

View reviewed changes

backend/src/api/public/v1/members/project-affiliations/getProjectAffiliations.ts Show resolved Hide resolved

themarolt merged commit d832a60 into main Mar 11, 2026
9 checks passed

themarolt deleted the feat/missing-endpoint-and-verifiedby-CM-1030-CM-1038 branch March 11, 2026 10:53

Conversation

themarolt commented Mar 10, 2026 • edited by cursor bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Mar 10, 2026

Uh oh!

github-actions bot commented Mar 10, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

CLAassistant commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

joanagmaia left a comment

Choose a reason for hiding this comment

Uh oh!

cursor bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

themarolt commented Mar 10, 2026 •

edited by cursor bot

Loading

CLAassistant commented Mar 10, 2026 •

edited

Loading